A fast Newton’s iteration for M/G/1-type and GI/M/1-type Markov chains
نویسندگان
چکیده
In this paper we revisit Newton’s iteration as a method to find the G or R matrix in M/G/1type and GI/M/1-type Markov chains. We start by reconsidering the method proposed in [14] which required O(m +Nm) time per iteration, and show that it can be reduced to O(Nm), where m is the block size and N the number of blocks. Moreover, we show how this method is able to further reduce this time complexity to O(Nr + Nmr + mr) when A0 has rank r < m. In addition, we consider the case where [A1A2 . . . AN ] is of rank r < m and propose a new Newton’s iteration method which is proven to converge quadratically and that has a time complexity of O(Nm +Nmr +mr) per iteration. The computational gains in all the cases are illustrated through numerical examples.
منابع مشابه
On the Dual Relationship between Markov Chains of Gi/m/1 and M/g/1 Type
In 1990 Ramaswami proved that, given a Markov renewal process of M/G/1– type, one can construct a Markov renewal process of GI/M/1–type such that the matrix transforms G(z, s) for the M/G/1–type process and R(z, s) for the GI/M/1–type process satisfy a duality relationship. In his 1996 PhD thesis, Bright used time reversal arguments to show that it is possible to define a different dual for pos...
متن کاملDetermination of Explicit Solution for a General Class of Markov Processes
In this paper, we study both the GI=M=1 type and the M=G=1 type Markov chains with the special structure A 0 = !. We obtain explicit formulas for matrices R and G, which generalized earlier results on Markov chains of QBD type. In the case of GI=M=1 type, we show how to nd the maximal eigenvalue of R, and then that the computation of R is equivalent to that of x 2. In the case of M=G=1 type, we...
متن کاملAn Invariant Subspace Approach in M/g/1 and G/m/1 Type Markov Chains
Let A k ; k 0, be a sequence of mm nonnegative matrices and let A(z) = P 1 k=0 A k z k be such that A(1) is an irreducible stochastic matrix. The unique power-bounded solution of the nonlinear matrix equation G = P 1 k=0 A k G k has been shown to play a key role in the analysis of Markov chains of M/G/1 type. Assuming that the matrix A(z) is rational, we show that the solution of this matrix eq...
متن کاملA Fixed Point Approach to the Classification of Markov Chains with a Tree Structure
In this paper, we study the classification problem of discrete time and continuous time Markov processes with a tree structure. We first show some useful properties associated with the fixed points of a nondecreasing mapping. Mainly we find the conditions for a fixed point to be the minimal fixed point by using fixed point theory and degree theory. We then use these results to identify conditio...
متن کاملAn Invariant Subspace Approachin M / G / 1 and G / M / 1 Type Markov
Let A k ; k 0, be a sequence of m m nonnegative matrices and let A(z) = P 1 k=0 A k z k be such that A(1) is an irreducible stochastic matrix. The unique power-bounded solution of the nonlinear matrix equation G = P 1 k=0 A k G k has been shown to play a key role in the analysis of Markov chains of M/G/1 type. Assuming that the matrix A(z) is rational, we show that the solution of this matrix e...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011